Universal Access To All Knowledge
Home Donate | Store | Blog | FAQ | Jobs | Volunteer Positions | Contact | Bios | Forums | Projects | Terms, Privacy, & Copyright
Search: Advanced Search
Anonymous User (login or join us)
Upload

Reply to this post | Go Back
View Post [edit]

Poster: cloud2013 Date: Jun 1, 2011 7:11am
Forum: GratefulDead Subject: files.xml URI format

I am trying to use RUBY to download information about GD recordings in the Internet Archive. I am starting with a get using the model from advanced search to get a list of shows by date in xml format. Typically this will return a uri for each show like:

http://www.archive.org/details/{the target}

where {the target} is something like:

gd1971-08-05.mtx.chappell.97014.flac16

I would now like to use this uri to get the files.xml list so I can get a machine readable SET LIST.
when I manually click on the [files] hyperlink I get back the files.xml from a uri like:

http://ia600402.us.archive.org/32/items/{the target}/{the target}_files.xml

I don't under stand these sections of uri:
what is the ia600402
what is the /32/
and how can I compose this uri programatically?

thanks

dlr

Reply to this post
Reply [edit]

Poster: Albert Schlef Date: Jun 1, 2011 7:44am
Forum: GratefulDead Subject: Re: files.xml URI format

The URL of "[files]" (or any other file) is constant:

http://www.archive.org/download/{the target}/{the target}_files.xml

When you fetch this URL, the server sends you a "302 redirect" to one of the many load-balancing mirrors where the file is stored. Just make sure your Ruby downloader can handle redirects.

Reply to this post
Reply [edit]

Poster: cloud2013 Date: Jun 1, 2011 12:42pm
Forum: GratefulDead Subject: Re: files.xml URI format

thanks Albert Schlef. That works correctly and like a charm.
(wow look at all the post backs - I am sorry to have responded to the first one)

Reply to this post
Reply [edit]

Poster: SomeDarkHollow Date: Jun 1, 2011 8:18am
Forum: GratefulDead Subject: Re: files.xml URI format

I don't like where this one is going.

If this is what I think it is, please take any and all discussions about grabbing restricted files off-line.

Reply to this post
Reply [edit]

Poster: cloud2013 Date: Jun 1, 2011 8:45am
Forum: GratefulDead Subject: Re: files.xml URI format

Dear SomeDarkHollow (whoever you are):
you wrote:
>>don't like where this one is going.
>>If this is what I think it is, please take any and all >>discussions about grabbing restricted files off-line.

Did someone mention restricted files?
Garbing the files.XML is the only way to get a valid track list for a given concert. Otherwise I need to parse the loose lists given in the description field.

What are you trying to protect?
Better yet: WHAT IS YOUR PROBLEM?
Since IA has the sound files stored already what would ANYONE want to replicate that storage locally?
How 20th Century of you.

I don't like your tone or your attempt to suppress free and public information on how IA works.

BTW: check out the spec's on the HTML5 tag.

peace

dlr

Reply to this post
Reply [edit]

Poster: SomeDarkHollow Date: Jun 1, 2011 9:36am
Forum: GratefulDead Subject: Re: files.xml URI format

What is my problem?

Tools looking for tools.

EDIT: I'm really hoping to get a "go fuck yourself", I've been waiting for an excuse.

Oh, yeah, and as for this whole "freedom of speech" bullshit, I'm all for it, except when the excercise of such can damage an entire group. We have been given an incredible gift here, and, yes, the marketing wonks took away access to the SBD's a while back, but that is their perogative. We have been left with free access to most AUDs...for now. As artistic property, Rhino et al can easily crack down on the easy access to ALL the music gathered here. In an attempt to keep this from happening, we strongly encourage folks to keep mum about whatever they may, or may not, be doing to get around the guidelines clearly put in place here at the Archive. Call me a tyrannical douchebag if you wish, my intentions are purely based on communal welfare and nothing more.

This post was modified by SomeDarkHollow on 2011-06-01 16:36:42

Reply to this post
Reply [edit]

Poster: micah6vs8 Date: Jun 1, 2011 8:57am
Forum: GratefulDead Subject: Re: files.xml URI format

You have a lot of brass to come in on your 3rd post and yelp about free speech rights. I love the 'peace' after bending the guy over the counter. (Rob, I'm sorry I need to borrow it, but you can have it right back). Fuck off. peace

http://tinyurl.com/3kb6w42

You caught me on the wrong day sonny.

Reply to this post
Reply [edit]

Poster: cloud2013 Date: Jun 1, 2011 9:04am
Forum: GratefulDead Subject: Re: files.xml URI format

can't anwser the charge?

Reply to this post
Reply [edit]

Poster: micah6vs8 Date: Jun 1, 2011 9:13am
Forum: GratefulDead Subject: Re: files.xml URI format

I'm not answering any 'charge'. What charge? A bit legalistic ,no? This is one of the worst, 'Hello I'm new here", I've seen. Hand out already. I'm sure you have endeared yourself to many. Boring.

edit- peace

This post was modified by micah6vs8 on 2011-06-01 16:13:47

Reply to this post
Reply [edit]

Poster: midnightcarousel Date: Jun 1, 2011 10:28am
Forum: GratefulDead Subject: Re: files.xml URI format

It's not what you think it is. What this guy is trying to do is completely legit, and it's not against any rules.

It's still probably the wrong forum for his question, though. Very few of us are tech-savvy enough to even know what the hell he's talking about.

Reply to this post
Reply [edit]

Poster: SomeDarkHollow Date: Jun 1, 2011 10:53am
Forum: GratefulDead Subject: Re: files.xml URI format

If so, my heartfelt apologies, but the individual could have pointed that out before jumping down my throat.


Please, no comments on what else is jumping down my throat.

Reply to this post
Reply [edit]

Poster: Jacky Hughes Date: Jun 1, 2011 1:09pm
Forum: GratefulDead Subject: Re: files.xml URI format

And perhaps you could have made sure you understood the conversation before you jumped down his throat.

The forum lynch mob ride again.

Reply to this post
Reply [edit]

Poster: SomeDarkHollow Date: Jun 1, 2011 1:54pm
Forum: GratefulDead Subject: Re: files.xml URI format

Fine, fine, fine. I'll admit I was hasty in my initial post, but I wouldn't classify it as jumping down his throat. Merely asking him to take the subject offline IF it was what I thought it was at the time. I even said please. He only needed reply without any malice "Perhaps you misunderstood my post, I am merely asking about getting titles for individual tracks and nothing more", or somthing similar. I fully take responsibility for my part, however I don't see our new friend offering up the same for his rather "forceful" reply.

On furthur review, it seems I took his post out of context and he did the same with mine. I certainly am not trying to restrict access to information in the public domain. Two trains on the wrong track.

Oh, yeah, I also refrained from using the dreaded ALL CAPS.

Just my two cents.

Moving on.

This post was modified by SomeDarkHollow on 2011-06-01 20:54:13

Reply to this post
Reply [edit]

Poster: Edsel Date: Jun 1, 2011 1:21pm
Forum: GratefulDead Subject: Re: files.xml URI format

Bingo !

Reply to this post
Reply [edit]

Poster: micah6vs8 Date: Jun 1, 2011 4:20pm
Forum: GratefulDead Subject: Re: files.xml URI format

What a bunch of sanctimonious, self-righteous nonsense.
Do you feel better now?
I know the attitude cloud wrote with, thank-you very much, and I don't like it. Vinegar.

Reply to this post
Reply [edit]

Poster: Jacky Hughes Date: Jun 3, 2011 12:56pm
Forum: GratefulDead Subject: Re: files.xml URI format

"Fuck off. peace"

"What a bunch of sanctimonious, self-righteous nonsense.
Do you feel better now?
I know the attitude cloud wrote with, thank-you very much, and I don't like it. Vinegar."

Yeah right, hoisted by your own petard I think.

Daft lad.

This post was modified by Jacky Hughes on 2011-06-03 19:56:50

Reply to this post
Reply [edit]

Poster: micah6vs8 Date: Jun 3, 2011 1:05pm
Forum: GratefulDead Subject: Re: files.xml URI format

An edit after I responded to your post? Come on.
Please, let us move on from here.

Reply to this post
Reply [edit]

Poster: robthewordsmith Date: Jun 3, 2011 1:18pm
Forum: GratefulDead Subject: Re: files.xml URI format

Yeah, he's good at that. You're running in the douchebag Olympics here, my friend, and it would be as well to leave the field to a more seasoned competitor.

Reply to this post
Reply [edit]

Poster: micah6vs8 Date: Jun 3, 2011 12:40pm
Forum: GratefulDead Subject: Re: files.xml URI format

I think you completely miss the meaning of what I wrote and I am not inclined to continue with this conversation. What good would come of it? We disagree.

Reply to this post
Reply [edit]

Poster: midnightcarousel Date: Jun 1, 2011 11:20am
Forum: GratefulDead Subject: Re: files.xml URI format

Well yeah, the fact that he wasn't doing anything against the rules doesn't make up for the rudeness in his response. I think he assumed you were posturing about something, when in reality you were just making sure he wasn't another oh_uh_um_ah, advertising to everyone how to download things illegally from the site

Reply to this post
Reply [edit]

Poster: dead-head_Monte Date: Jun 1, 2011 10:35am
Forum: GratefulDead Subject: Re: files.xml URI format

http://www.archive.org/post/352580/a-million-songs-yet

http://www.archive.org/post/353586/well-over-1-million-songs

DeadBase Online Search

The DeadLists Project

Grateful Dead Betty Boards archive

The Annotated Grateful Dead Lyrics

Grateful Dead Family Discography



This post was modified by dead-head_Monte on 2011-06-01 17:35:52

Reply to this post
Reply [edit]

Poster: micah6vs8 Date: Jun 1, 2011 8:47am
Forum: GratefulDead Subject: Re: files.xml URI format

Like SDH, I was even less sure, but I had an inkling.
As the once and future PM told me, this whole deal, the GD forum and the 'important' parts of LMA are given. They can immediately be taken away from all.
Please, please refer to 'Show policy notes'.
And you seem to be able to get around the net. Poke around.

Reply to this post
Reply [edit]

Poster: polarized blue Date: Jun 1, 2011 9:10am
Forum: GratefulDead Subject: Re: files.xml URI format

yeah, not really sure what it all means - I'm only semi-computer-literate, and I don't really want to know if it isn't in line with the policy, so please don't explain it to me. But if you're ONLY looking for the SET List, why not click the text file link of the show in the other information area, that has generally got the text file of the set list, and any info about the recording you are listening to. Or for more set list info, try the helpful websites linked on the main forum page, like deadlists, or look up deadbase. There are very helpful resources out there for set lists of grateful dead shows.

Reply to this post
Reply [edit]

Poster: cloud2013 Date: Jun 1, 2011 12:44pm
Forum: GratefulDead Subject: Re: files.xml URI format

the deadbase is less than flexible for my intended uses. And this one is open and fast so why not use it.